Moral Reminder as a Way to Improve Worker Performance on Amazon Mechanical Turk
نویسنده
چکیده
The present study explores a method to reduce abusive worker behavior on Amazon Mechanical Turk (AMT), namely reminding workers of moral standards. We manipulated workers’ awareness of moral standards via the presence or the absence of an honesty statement in a survey. The results showed that the honesty statement significantly improved workers’ performance during the first half of the survey. This suggests that a moral reminder is a simple and efficient way to reduce abusive worker behavior in a relatively short survey on AMT.
منابع مشابه
A Framework for Quality Assurance in Crowdsourcing
The emergence of online paid micro-crowdsourcing platforms, such as Amazon Mechanical Turk (AMT), allows on-demand and at scale distribution of tasks to human workers around the world. In such settings, online workers come and complete small tasks posted by a company, working for as long or as little as they wish. Such temporary employer-employee relationships give rise to adverse selection, mo...
متن کاملMmmTurkey: A Crowdsourcing Framework for Deploying Tasks and Recording Worker Behavior on Amazon Mechanical Turk
Internal HITs on Mechanical Turk can be programmatically restrictive, and as a result, many requesters turn to using external HITs as a more flexible alternative. However, creating such HITs can be redundant and timeconsuming. We present MmmTurkey, a framework that enables researchers to not only quickly create and manage external HITs, but more significantly also capture and record detailed wo...
متن کاملMonetary Interventions in Crowdsourcing Task Switching
With a large amount of tasks of various types, requesters in crowdsourcing platforms often bundle tasks of different types into a single working session. This creates a task switching setting, where workers need to shift between different cognitive tasks. We design and conduct an experiment on Amazon Mechanical Turk to study how occasionally presented performancecontingent monetary rewards, ref...
متن کاملSources of Variability and Adaptive Tasks
It is known that micro-task worker performance fluctuates. While between-worker variability has been studied and has been used to define filters (e.g., to filter out “bad” workers), within-worker variability (i.e. how each worker's performance varies over time) has received less attention. Better understanding of the sources of such variability will result in the design of better filters, and m...
متن کاملInserting Micro-Breaks into Crowdsourcing Workflows
Participants in human computation workflows may become fatigued or get bored over long, interminable working hours. This leads to a slump of motivation and morale, which in the long run causes reductions in both productivity and work quality. In this paper we propose an initial investigation into possible ways to alleviate worker fatigue and boredom by employing micro-breaks that provide timely...
متن کامل